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Preface 


This is an evaluation report of the Central Level Training of Learning 
Strategies and Learning Evaluation conducted for the field staff 
(FCs/RPs). It is the second of the 4'part evaluation-PreparaUon . 
Training of trainers, District training and Impact-intended to 
evaluate the process of training from concept to classroom 
implementation, 

I hope the reports-will provide valuable insights to the Project and 
MOEC on this key area of education-inservice training 

I extend my thanks to Mr Michael Kiernan, Project Adviser PEP/UNICEF 
for educating us with his expertise , insights and comments in all 
phases of this study. My special thanks go the Chief of PSTO for 
providing valuable suggestions for the study 

I also acknowledge the help of the trainers of PSTU and PEP trainees 
extended to us in the course of the study, 


Uddhab B. Karki 
Chief 

Evaluation Unit 
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i_l Background 




In response to the Basic Needs Teacher Training Prograirune, PEP 
developed two new training packages - Learning Strategies and Learning 
Evaluation, thus completing a 150 hr training for the teachers 
concerned. These packages were tried out in six RCs of the project 
districts to identify the effectiveness of the packages and to train 
the trainers of the PSTU. After field testing they were revised and 
edited on the basis of the experiences gained . Then the packages were 
produced to train field staff (FCs/RPs). 


The field staff of the PEP were trained in the package at the central 
level by the PSTU trainers . These trainings were conducted for two 
groups of the Project (1935 and 1986). Altogether 60 field trainers 
received the trainings . 


L2 GeMial Background ^ the Res pondents 


The FCs and RPs had already received trainings in a) Introduction to 
the PEP, b) Teaching Methodologies, c) School Management, d) 
Materials, and e) Supervision. Almost all of the trainees possess a 
Diploma or a Degree in Education and experience of teaching and/or 
administrative work. Also , the trainees have experience of the PEP 
implementation process. 


In previous trainings , RPs tended to work in pairs: this practice has 
adversely effected the Supervision Programme. RPs were informed that 
in future only one RP would conduct a training but that he/she could 
have assistance from selected teachers from satellite schools, 
Therefor a RP , in preparing for the training , could work with 2 to 
3 teachers and thereby share the training load, Resistance to the 
One RP one training " idea is based on the prescription that there is 
too much work for one trainer over a 12"day period. The new approach 
stresses the role of a trainer as facilitator and puts the onus of 
work on the teachers themselves; secondly, a more systematic approach 
to training materials strengthens the self-instructional element , 
thus reducing the amount of work for the RP. 
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1 3 Objective of the Study 

The objectives of this study are: 

’ to test the effectiveness of new training approach 

to identify the level of achievement of the trainees of the cont 
of the packages 


i-i Eating Scale 


A five point rating scale was used to evaluate the training. The sc 
ranges 1 (low) to 5 (high). This scale was used as indicated in b? 
box in terms of percentage and description . 


Scale 

1 

2 

3 

4 


Percentage 

1-20 

21-40 


41-60 

61-80 



no agreement 


some agreement 


average agreement 
largely in agreement 


81-iOO 


total agreement 




2 . 


Summary ol Findinis and RecomsiendationB 


2„l and Pgat Score 


The average score of pre- and post test are 31 and SB respectively 
The variation of the scores between trainees in pre- test score higher 
than the post scores. The achievement score of the trainees is 
significant at 01 level of significance, Two issues arise from these 
findings : a) the surprising low level of professional knowledge of 
RPs and b) the effectiveness of the training insofar as raising their 
knowledge in the areas concerned (see Table below for details) 
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md P^t Score of the Trainee 


Pre-Test 

Score 

N=33 


Post Test 
Score 
N=33 


1 

2 

3 

4 

5 

6 
7 

a 

9 

10 
11 
12 

13 

14 

15 

16 

17 

18 

19 

20 
21 
22 

23 

24 

25 

26 

27 

28 

29 

30 

31 

32 

33 


60 

56 

52 

50 

50 

48 

44 

44 

40 

36 

36 

34 

34 

33 

33 

33 

28 

20 

27 

27 

26 

25 

20 

20 

18 

10 

17 

16 

15 

14 

14 

12 

11 


Average 
Std. Dev 
Minitnum 
Maximum 


30.00 
13.62 
11.00 
60.00 


81 

70 

79 

76 

76 

74 

72 

72 

72 

72 

72 

70 

70 

70 

70 

68 

68 

68 

68 

66 

66 

66 

64 

64 

64 

64 

62 

62 

62 

60 

60 

56 

56 

67,00 

5.91 

56.00 

81.00 



PRB AND PO??T TEST AyBRAOBX'STD-DHV SQO 



S a HODS 
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2Averse Scores (combined Trainers and Trainees rati ng 
scores! on the Aspects of Training 


Aspects o| Training G rand Average Score 

(In percentage! 


I Appropriateness of Contents 4.03(80) 

2. Usefulness of Hand-outs 4.04(80) 

3 Appropriateness of Methods/Activity 3,93(78) 

4. Effectiveness of the Conduct of Training 

Sessions 4.06(81) 

5. Opinion of FCs and RPs as to 

conducting this package at RCs 3.90(78) 

6. New Knowledge and Ideas Gained 4.0(80) 

7 Helpful to Improve Quality of Classroom 

Instruction 4,0(80) 

Total 4,0(80) 


2,3 The training conducted at central level has succeeded to a large 
extent. A study of the district level training will be done to 
determine the effect of the central level training, followed by a 
study of the impact of the series of trainings on the real target 
group classroom students. 
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Recommendations 


2.4 


A, As the findings of the study indicate that the training has been 
largely successful , the training package and Its modalities of 
operation should be retained and continued for the 1987 group of 
FCs and RPs, 


B The training materials for filed-staff should be pre-tested by 
central staff themselves. 


C. The core of the training should be a thorough study and 
demonstration of the essential concepts involved. The principle 
must be that "a field staff member (FC/RP) should not expect a 
teacher to do what he/she (FC/RP) cannot demonstrate 

himself/herself". 


D. The proposed follow-up evaluations (district level and 
classroom impact) should be carried out using as large a 
sample as possible. 


E. All future trainings should , as far as possible , carry out pre 
and post tests. 
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Annex-1 

Methodology 


U Population 

The population of this study was all the trainees (GO), trainers l6) 
and programme developers, 


2_.. S ample 

The RPs , FCa and trainers were the population of this study. 81 
percent of the total were actually available for this study 


L Procedures of Data Collection 


In accordance with the objectives of the study, the following 
procedures were used to collect the data and information required for 
this study: 


(i) Formal/Informal Discussion 

Formal and Informal discussions were held with the trainers and 
trainees about the content of the package, methods of operation and 
achievement made from the training. 


(ii) Interview 

About 6 percent of the trainees were interviewed about the relevancy 
of the package and its method of operation. 


(iii) Interview Schedule and Questionnaire for Trainers/Trainees 


A questionnaire consisted of 15 items related to 
training package was administered to the trainees 
ascertain their perception towards the training 
implementation. 


the all aspects 
and trainers to 
package and its 



(IV] Pre and Post Test 


"IQ" 


< trainees before and after participatlaj 
To teat the knowledge oj tne ^ developed focusing on the 

In the training , a pre- and pos development process and 

contents of the training P 
test natrir are as follows; 


1 , Test Development Process 


1 , 


j- in+Vi the Adviser and trainers of 

The chief evaluator discus ^ 

the PSTU about the number and types oi 

test, 


2 . 


Each trainer developed a set 
they were responsible for 
them and finalised the test. 


of test items of the topic which 
Then the evaluator discussed with 


3. 


The Project Adviser looked at the test thoroughly and gave final 
shape to the test. 


4 , The evaluator and trainers developed the marking scheme. 


b, Test matrix 


t) saviH Pnqt test consists of 20 items representing comprehension and 

Sui-taUri., Tb. •< ‘‘a.T..r.< t 

according to the training aspects and contents. The det 
test is as below' 
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Test Matrix 


A. 

Learning Strategies 



Contents 

Types Of Items And Quantity 

Total 

Total 


Comprehension 

Application 

Items 

Marks 

1 Learning Activities 

1 

1 

2 

10 

2, Learning and Memorisation 1 

1 

2 

10 

3. Affective Domain 

1 

1 

2 

10 

4, Concept Development 

1 

1 

2 

10 

5 Visual Aids/Instructional 




Materials 

1 

1 

2 

10 

Total 

5 

5 

10 

50 

L 

Learning Evaluation 



Contents 

Types Of Items And Quantity 

Total 



Comprehension 

App^cation 

Items 

Marks 

1. Evaluation and 





Examination 

1 

1 

2 

10 

2 Measurement aspects 

1 

1 

2 

10 

3. Test Matrix Objective 




10 

, Weight and Balance 

1 

1 

2 

4. Types of Questions 

1 

1 

2 

10 

5. Test Construction and 




10 

Administration of Test 

1 

1 

2 

6. Scoring and analysis of 

1 

2 

10 

answer sheets 

1 

Total 

5 

5 

10 

50 


A. Learning Strategies 50 

B, Learning Evaluation 50 


Grand Total 


100 
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The perceptions of the trainee 
providing scores which range from 1 (lo ) 
interpreted on the basis of grand averag 


trainers were analyzed by 
to 5 (high). And these were 
of the item. 


The pre and 
separately. The 


post scores 
scores were 


of the knowledge test were 
analysed using t- test method. 


computed 
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Annex-2 

Description of the Training Package. 

1. Trainin g P ackag e 

This training package consisting of Learning Strategies and Evaluation 
was developed for teachers who had received the training in Teaching 
Methodology and Educational Materials. This package is in line the 
' H^^gic Need Teaoher Training PrograitmeN hich is intended to provide 
training of 150 hours. 

L Objective s 

The objectives of this training packages are (i) to train the FCs/RPs 
in the contents and methods of Learning Strategies and Evaluation and 


(ii) to make FCs/RPs proficient in conducting the training of 
Learning Strategies and Evaluation for primary school teachers, 

L 

Contents 


The contents and allocation of time of the training package were as 
below. 

a. Learning Strategies AUpc 

ated Time (hours) 

1. 

Activity oriented learning 

5.5 

2 

Learning and memorisation 

5.5 

3. 

Affective aspects of learning 

5.6 

L 

Concept development 

5.5 

5. 

Visual aids and learning 

5.5 

6 , 

Project Work (including Practice Teaching) 

5.5 


Total 

38.5 
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b. Le arning Evaluation Allocated Time jhour^ 


1 

Evaluation and examination 

5.5 

2. 

Measurement aspects 

5.5 

3. 

Test construction 

5,5 

4. 

Types of questions 

5,5 

5. 

Test administration 

5.5 

6 , 

Project work (including Classroom Testing) 

5.5 


Total 

38.5 


L loMsS Methods 

The following methods/techniques were used while conducting the 
training. 

ii) of problems : collections of information, demonstration 

and discussion 

(ii) Demonstration by trainers of key concepts and skill 

(iii) Preparat ion of activity oriented lessons by trainees (workshop) 

(iv) Presentation ; as to prove mastery of essential concepts 
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In terpretation 

The means o± the pre-test and post-test scores are 31 and 88 
respectively The achievement made by the trainees Is 
significantly high at the 01 level of significance. It indicates 
that the trainees have increased their knowledge As most of the 
questions (50%) were in the Application category, the active 
involvement of the trainees in the training activities and a 
sufficient amount of practical exercises contributed greatly to 
significant scores gain by the trainees. 


The trainees (FCs/RPs) and trainers were largely in agreement 
with the appropriateness (80%) of contents of the training to 
develop the knowledge and skills of learning strategies. The 
evaluator’s study also showed that the contents were to a large 
extent relevant to the current needs of the primary teachers (see 
Annex-4 and 4.1 for details), 


The trainees (FCs/RPs) were largely in agreement (80%) with the 
usefulness of the hand-outs and the trainers also perceived (84%) 
that the hand-outs were largely helpful to conduct sessions. The 
evaluator noticed that these hand-outs had many examples and that 
matters were explained clearly. These are useful to the 
participants in grasping the contents of the trainings easily 
(see Annex-4 for details). 


The trainers and trainees were largely in agreement with the 
appropriateness (78%) of the methods and techniques used to 
conduct the sessions. The evaluator observed that the methods and 
activities were participants oriented and there was an active 
participation of the trainees in each training session (Bee Annex 
4 and 4.1 for details). 


The trainers as well as the trainees had total agreement with 
effectiveness (81%) of the conduct of the training sessions in 
achieving the objectives of the training . The evaluator thought 
that the practical exercises and group work contributed to make 
the training sessions effective and useful (see Annex 4 and 4.1 
for details) 
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6, The trainees were largely in agreement (70)1) that they cj i 
become proficient in conducting the training of teachers ' 
learning strategies and evaluation at ECs This also matches t " 
assessment of the trainers and evaluators, (see Annex-i and i* 
for details), ' 


I The trainers and trainees were in agreement (8M) that 
gained new knowledge and skills in relation to I’liajjim 
Strategies and Learning Evaluation'* The evaluator alsn 

this through discussion with the trainers and trainees (see Im 
4 and 4,1 for details) * 


8, The trainees and trainers agreed to a large extent (811^) that tk 
training would help to improve the quality of classro® 
instruction , (see Annex 4 and 4,1 for details) 
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RATING SCORES ASSIGNED BY TRAINEES (FCS/RPS) AND TRAINERS OtJ 
rHE ASPECTS OF THE LEARNING STRATEGIES AND EVALUATION TRAINING 
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SUMMARY OF TABLES (1-B) 
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B. SUMMARY OF TABLES (9-16) 

RATING SCORES ASSIGNED BY TRAINEES (FCS/RPS) AND TRAINERS ON THE ASPECTS OF LEARNING EVALUATION 
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Aanex-5 

Partiaipanta 


The participants of this 
groups Altogether go 
representing six project 
the participants: 


Id Staff participated 
istricts. The table below 


of 1985 and 1986 
in this training 
shows the details 


Distr ic t 


Jhapa 

Dhankuta 

Tanahu 

Kaski 

Dang 

Surkhet 

Total 


1905 Group 

BE ToJai 


3 6 g 

1 3 4 

2 4 6 

3 5 8 

2 4 6 

1 2 3 

12 24 36 


l-§86 Group 
■RP3~ 

Total 

Ssicentp^e 

5 

14 

23 

4 

8 

13 

4 

10 

17 

5 

13 

22 

4 

10 

19 


5 8 

60 100 



